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Abstract. In this paper we present an explicit (rank one) function transform 
which contains several Jacobi-type function transforms and Hankcl-type trans- 
forms as degenerate cases. The kernel of the transform, which is given explicitly 
in terms of basic hypergeometric series, thus generalizes the Jacobi function as 
well as the Bcsscl function. The kernel is named the Askcy- Wilson function, 
since it provides an analytical continuation of the Askey-Wilson polynomial 
in its degree. In this paper we establish the L 2 -theory of the Askey-Wilson 
function transform, and we explicitely determine its inversion formula. 



1. Introduction. 

In H several explicit function transforms are realized as Fourier transforms on 
the non-compact quantum SU(1, 1) group. In this paper we focus on the function 
theoretic aspects of the most general Fourier transform on the quantum SU(1, 1) 
group. Since the corresponding radial part of the Casimir operator is Askey's and 
Wilson's second order g-difference operator L, we are led to the task of studying 
its spectral properties as a symmetric operator with respect to an explicit measure 
of unbounded support. This measure naturally arises in [^| as a Haar weight on 
the quantum SU(1, 1) group. The kernel of the corresponding generalized Fourier 
transform is an eigenfunction of L, and it provides an analytic continuation of 
the Askey-Wilson polynomial in its degree. Consequently, we name the kernel the 
Askey-Wilson function. 

The Askey-Wilson function satisfies a beautiful symmetry property, which we 
refer to as duality in this paper. It essentially states that the geometric and the 
spectral parameter of the Askey-Wilson function are interchangeable (up to a cer- 
tain involution on the parameters). 

For a full exploitation of duality for the development of the L 2 -theory of the 
corresponding generalized Fourier transform, it is necessary to add another degree of 
freedom. This can be done in the following natural way. The Askey-Wilson function 
can be expanded as a linear combination of the asymptotically free solutions of L 
on an arbitrary g-lattice. The corresponding explicit coefficients, the so-called o 
functions, can then be used to define an explicit measure whose support around 
infinity lies on the chosen g-lattice. This gives rise to a one parameter family of 
measures of unbounded support, in which the extra parameter labels the different 
(/-lattices. It contains the measure arising from the quantum SU(1, 1) group as a 
special case. 

The generalized Fourier transform with respect to this one parameter family of 
measures, and with the Askey-Wilson function as its kernel, is called the Askey- 
Wilson function transform. In view of its harmonic analytic interpretation on the 
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quantum SU(1, 1) group, we may think of the Askey- Wilson function transform 
as a generalization of the classical Jacobi transform, whence in particular of the 
Mellin-Fock (or Legendre) transform. In fact, it was shown in JhJ that the Askey- 
Wilson function transform is on top of an hierarchy consisting of several different 
generalizations of the Jacobi and Hankel transform. In particular, the i 2 -theory for 
the Askey- Wilson function transform unifies the L 2 -theory for the spherical Fourier 
transform on the (quantum) SU(1, 1) group as well as on the (quantum) group of 
plane motions. 

The main objective of the paper is to show that the Askey- Wilson function 
transform extends to an isometric isomorphism in a natural way, and that its inverse 
is the Askey- Wilson function transform with respect to a different, "dual" choice 
of parameters. 

We expect that the present theory on the Askey- Wilson function transform will 
turn out to be the special rank one case of a general theory on Macdonald function 
transforms associated with root systems, in analogy with the polynomial setting (see 
e.g. 12 , J|). From this point of view, it is natural to expect that the structure 



of the Askey- Wilson function transform, and eventually also the structure of the 
general Macdonald function transform, will be best understood from an extension 
of Cherednik's [0 affine Hecke algebraic approach to the non-polynomial setting. 
A first indication of the pivotal role of affine Hecke algebras in the structure of the 
Askey- Wilson function transform is the duality, which in the polynomial setting 
stems from an involution of the associated double affine Hecke algebra (see for 
instance ||, and 13 , |Q for the rank one setting). We hope that future research 



will shed more light on these matters. 

The set-up of the paper is as follows. In §2 we recall the Askey- Wilson polynomi- 
als and in §3 we define the Askey- Wilson functions. We emphasize in these sections 
the important concept of duality. In §4 the asymptotically free solutions of L are 
discussed, as well as the corresponding c-function expansion of the Askey- Wilson 
function. We formulate our main result in §5, which states that the Askey- Wilson 
function transform extends to an isometric isomorphism in a natural way, and that 
its inverse is given by the Askey- Wilson function transform with respect to dual 
parameters. 

The remaining sections occupy the proof of the main result. Duality plays a 
pivotal and simplifying role in the proof, since it allows us to avoid the machinery of 
spectral analysis of (unbounded) self-adjoint operators (in contrast with the analysis 
in some of its degenerate cases, see e.g. §, § and §). The other main ingredient 
of the proof is the computation of the weak limit of the Wronskian of the Askey- 
Wilson functions. As an interesting by-product of this computation, we obtain in 
§7 explicit orthogonality relations for "low degree" Askey- Wilson polynomials with 
respect to the one-parameter family of measures of unbounded support. 

Notations and conventions: We assume that < q < 1 is fixed throughout 
the paper. We use the standard notations for basic hypergeometric series, see for 
instance (i). In particular, we write (oi, ■ ■ ■ ,a r ',q) c — T[i=i{ a ii l) c with (a;q) = 
(a; q) / (aq c ; q) and (a; q) = IlSo(l — a( f) f° r (products) of g-shifted factorials, 
and we write 

fa u a 2 ,... ,a r +i \ (ai,a 2 ,... ,a r+1 ;q) 
r+i9r[ , , , ,q,z\=} j —— z 



61,62,... A J ^ (g, ,b r ;q) 
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for the r+i^r basic hypergeometric series. The very well poised 807 is defined by 

Tir , , , , , ^l~aq 2k (a,b,c,d,e,f;q) z k 

$W 7 {a;b, c,d,e,f;q,z) = > — -, — . . 

^ 1-a {q,qa/b,qa/c,qa/d,qa/e,qa/f;q) k 

We use the branch of the square root y^ - which is positive on K>o throughout the 
paper. 
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2. The Askey- Wilson polynomials. 

In this section we briefly recall the basic properties of the Askey- Wilson poly- 
nomials. We formulate these properties in such a way that the connections with 
the non-polynomial setting (see section 5) will be as transparent as possible. In 
particular, we emphasize the important concept of duality. 

The Askey- Wilson polynomials p n {x) — p n (x;a,b,c,d;q) (n e Z + ) are defined 
by the series expansion 

/ \ , fq' n ,q n ~ 1 abcd,ax,ax~ 1 \ , 
P-W ab ,ac,ad '^)' ^ 

see jj]. If we associate dual parameters 5, 6, c and d with a, 6, c and d by the 
formulas 



5 = y q 1 abcd, b = ab/d = qd/cd, ^ 

c = ac/d = qd/bd, d — ad/d = qd/bc, 

then it immediately follows from the explicit expression (^l]) that the Askey- Wilson 
polynomials satisfy the duality relation 

p n {aq m ;a,b,c,d;q) = p m (dq n ;d,b,c,d;q), m,neZ + . (2.3) 

The deeper understanding of duality stems from affine Hecke algebraic considera- 
tions, see [ [l3| . 

The Askey- Wilson polynomials {p n }nez + form a basis of the polynomial algebra 
C[a;+a; _1 ] consisting of eigenfunctions of the Askey- Wilson second order (^-difference 
operator 

L = a(x)(T q -l)+a(x~ 1 )(T- 1 -l), 

(1 - ax)(l - bx)(l - cx){\ - dx) (2.4) 
a{X > ~ (1 - x 2 ){\ - qx 2 ) ' 

where (T^ zl f)(x) = f{q ±1 x). The eigenvalue of L corresponding to the Askey- 
Wilson polynomial p n is /x(7„), where j n = dq n and 

/i( 7 ) = -1-a 2 + 5(7 + 7^). (2.5) 

We remark that the three term recurrence relations for the Askey- Wilson poly- 
nomials p m (-;d,b,c,d;q) (m G Z+) can be derived from the eigenvalue equations 
Lp n = fi(j n )Pn (n e Z+) by applying the duality (|2~3|), see e.g. Q and 
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For the remainder of this section, we restrict our attention to the case that the 
parameters a, 6, c and d are positive and less than one. Then Askey and Wilson [0 
proved the orthogonality relations 

3 d Res (^M) 

TT-TT \ Pn(x)p m (x)A( X )— = 8 m ^ X ~ 10 (2.6) 
27rjGo J xeT x Reg / A(x)\ 

i=i„ V x / 

where <5 m)n is the Kronecker delta and T is the counterclockwise oriented unit circle 
in the complex plane, with the weight function given by 

(x 2 l/x 2 -n) 

[ax, a/x,bx,b/x,cx,c/x, ax, a fx; q) 

and with A(x) the weight function A(x) with respect to dual parameters. Here the 
positive normalization constant Co is given by the Askey- Wilson integral 

Cq= 1 f A{x) dx_ 2(a bcd ; q ) x 



2ni J x£T x (q,ab,ac,ad,bc,bd,cd;q) c 



The orthogonality relations written in the form ( |2.6| ) exhibit the duality (I2JJ) of 
the Askey- Wilson polynomials on the level of the orthogonality relations, since 
it expresses the quadratic norms explicitly in terms of the dual weight function 
A. This description of the quadratic norms was proved in Jl3| using afhne Hecke 
algebraic techniques. 

The above results describe the spectral properties of the Askey- Wilson second 
order g-difference operator L as a unbounded symmetric operator on the weighted 
L 2 -space with respect to the measure A(a;)— on the unit circle T. For suitable 
parameter values, this is directly related to harmonic analysis on the compact 
quantum SU(2) group, see e.g. [ O . 

In this paper we study the spectral analysis of L as a symmetric operator with 
respect to a one-parameter family of measures of unbounded support. This setting 
naturally arises in the study of harmonic analysis on the non-compact quantum 
SU(l, 1) group, see Duality, which we have emphasized in this section on the 
polynomial level, will play a crucial role in the development of the corresponding 
L 2 -theory. 



3. The Askey- Wilson function. 
In this section we consider a solution of the eigenvalue equation 

(Lf)(x) = »( 1 )f(x), (3.1) 

which reduces to the Askey- Wilson polynomial for 7 = j n (n S Z_|_), and which 
enjoys the same symmetry properties as the Askey- Wilson polynomials. 



Two linearly independent solutions of the eigenvalue equation (3.1) can be de- 
rived from Ismail's and Rahman's [|[ (1.11)— (1.16)] solutions for the three term 
recurrence relation of the associated Askey- Wilson polynomials. The solutions are 
given in terms of very well poised $4>7 series. In this section we consider the solution 
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7 (x) = 7 (x; a; b, c; d; q) of ( |3.l| ) given by 
^ ^ (9ax7/J,qa7/Jx;q) oo 



(a6c7, 57/d, qd/d, qx/ d, q/ dx; q) ^ (3.2) 
x 8 T^ 7 (dac7/q; ax, 0/^,07,07, 67; q,q/d7), I9/J7I < 1. 



This solution of ( |3.l| ) is also the subject of study in Suslov's papers [[L5|, ]lq] in 
which Fourier-Bessel type orthogonality relations are derived, see also remark |2j. 
Applying Bailey's formula (III. 36)] shows that 

1 / ax, a/x, 07,0/7 

Ux) -(bc, q a/d, q /ad;q)J^\ ab,ac,ad ' q ' q 

(az, a/x, 07, a/7, qb/d, qc/d; q) x 

(qx/ d, q/ dx, gry/d, q/dry, ab, ac, be, qa/d, ad/ q; q) 



X4(p3 { qb/d,qc/d,q 2 /ad ' q ' Q 



cf. |T^, (2.8)], hence 7 (x) extends to a meromorphic function in x and 7 for 
generic parameters a, 6, c and d, with possible poles at x ±x — q 1+k j d (k G Z+) and 



7 ±i = ^i+fe/^ (fc e It follows from (gj) that 7 ±i(x ±:L ) = 7 (x) (all sign 

combinations possible), and that 7 satisfies the duality relation 

07 (x; a; 6, c; d; q) = 0^(7; a; 6, c; d; q). (3.4) 

In the remainder of the paper we use the short-hand notation 0a; (7) for the right- 
hand side of (EO). 



Observe that the meromorphic continuation (3.3) of 7 (x) implies that 



7 „(x) = 77 1 7 p n (x), n G Z+, (3.5) 

(6c, qa/d, q/ad; q)^ 

since the factor (a/7; q) in front of the second 403 vanishes when 7 = j n = aq™ 



for n G Z+. In particular, the duality (2^3) of the Askey- Wilson polynomials is a 
special case of the duality (3.4) of 7 . 



Definition 1. The solution 7 (see ( |3.2j ) and ( |3.3j )) 0/ the eigenvalue equation 
(Lf)(x) = (J-('y)f(x) is called the Askey- Wilson function. 

4. The c-function expansion. 

We observed in the previous section that the poles of the Askey- Wilson function 
7 (x) for |x| ^> lie on the q-line {dq~ 1 ~ k }kez + ■ In this section we consider the 
Askey- Wilson function 7 (x) for \x\ ^> and x lying on the q-line / = {dtq k }kez, 
where t ^ q z is an extra degree of freedom. 

Observe that the eigenvalue equation ( |3.l| ) is asymptotically of the form 

a 2 (/(qx) - /(*)) + (fiq-'x) - f(x)) = /i( 7 )/(x) (4.1) 



when |x| — > 00. For generic 7, the asymptotic eigenvalue equation (4.1) has a basis 
{$ 7 Vee , <& _*i e } of solutions on the q-line /, where 

^ ree (dtq k ) = (d 7 )- fc , k G Z. 
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Furthermore, for generic 7 there exists a unique solution $ 7 (x) of the eigenvalue 
equation (3.1) on / of the form $ 7 (x) = ^i f ree (x)g(x), where g has a convergent 
power series expansion around |x| = 00 with constant coefficient equal to one. $ 7 
is the so-called asymptotically free solution of the eigenvalue equation (3.1). 

An explicit expression for $ 7 can be obtained from Ismail's and Rahman's [|J 
(1.13)] solution of the three term recurrence relation for the associated Askey- 
Wilson polynomials. After application of the transformation formula j|, (III. 23)] 
for very well poised 807's, it can be expressed as 

$ _ (qaj/ax, qb-j/ax, gey /ax, qdj/dx, d/x; q) x 

7 (q/ax,q/bx,q/cx,q/dx,q 2 j 2 /dx;q) oo (4.2) 

x 8 W 7 (q-y 2 /dx; qy/a, q-f/d, 67, cj, q/dx; q, d/ x) ®f ree (x) 

for x £ I with |x| 3> 0. We now expand the Askey- Wilson function ^(x) as 
a linear combination of the asymptotically free solutions $7(2;) and $ 7 -i(a;) for 
x £ I with |x| ^> 0. The coefficients in this expansion can be expressed in terms of 
the c- function 0(7) = 0(7; a; 6, c; d; q; t), which is defined by 

c(7) = 1 (ah,b/ 1 ,c/ T , q ) oo e( 1 /dt) 

(ab,ac,bc,qa/d;q) oQ 6(qadt) (qj/d, I/7 2 ; q) x 

where 8{x) — [x, q/x; qj is the renormalized Jacobi theta function. We call 0(7) = 
0(7; a; b, c; d; q; t) the dual c-function, with the dual parameter t defined by 

t = l/qadt. (4.4) 



Proposition 1. Let x £ I with \x\ 3> 0. Then we have the c-function expansion 
M x ) -c( 7 )$ 7 (a;)+c'(7- 1 )$ 7 -i(x) (4.5) 

for generic 7. 

Proof. Apply Bailey's three term recurrence relation (III. 37)] with its parameters 
specialized as follows: 

a^qj 2 /dx, b—tq/dx, c—tq^/d, d^qj/d, e — > 67, / — * 67. 

This gives an expansion of the form Q4.5| ) for explicit coefficients 0(7) and c(7 _1 ), 
which at a first glance still depend on x £ I. Using the functional equation 

e(q k x) = q-? k(k - 1) {-x)- k 9(x), k£Z (4.6) 

for theta functions, it is easily seen that the coefficients are independent of x and 
that they coincide with the dual c-functions c(7 ±1 ) as defined above. □ 

5. The Askey- Wilson function transform. 

In this section we define the Askey- Wilson function transform and we state the 
main result of this paper. At this stage we need to specify a particular parameter 
domain for the five parameters (a, 6, c, d, t) in order to ensure positivity of measures. 

Definition 2. Let V be the set of parameters (a,b,c,d,t) £ K. satisfying the con- 
ditions 

t <0, < b,c < a < d/q, 

bd, cd > q, ab, ac < 1. 
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Observe that b, c < 1 and d > q for all (a,b,c,d,t) £ V. The domain V is 
self-dual in the following sense. 



Lemma 1. The assignment (a,b,c,d,t) i— > (a, 6, c, d, t) defined by (2.2) and (1.4), 
is an involution on V . 

Proof. Direct verification. □ 

We fix parameters (a, 6, c, <i, t) € for the remainder of the paper. For the 
moment we furthermore assume that x i— » l/c(x)c(x _1 ) only has simple poles. 
This imposes certain generic conditions on the parameters (a, 6, c, d, t), which will 
be removed later by a continuity argument. 

It is convenient to renormalize the function l/c(x)c(x~ 1 ) as follows, 

1 (qx/d,q/dx,x 2 ,l/x 2 ;q) 

W(x) = = v ' ' ' /o ° j (5,i) 

c(x)c(x~ 1 )c (ax,a/x,bx,b|x,cx,c/x■,q) aa 9{dtx)9(dt/x) , 

where cq is the positive constant 

(ab, ac, be, qa/d; q) 1 oo 9(adt) 2 
c — 5 . (5.2) 



It follows from (|j) that 



where A(-) is the weight function (2.7) for the Askey- Wilson polynomials. By (4.6), 
the quotient of theta functions in (5.3) is a quasi-constant, i.e. it is invariant under 
replacement of x by qx. In particular, the weight function W{x) differs from A(ir) 
only by a quasi-constant factor. 
Let S be the discrete subset 

S = {xeC\ \x\> l,c(x) = 0} = S+US-, 

S+ = {aq k | k € Z+, aq k > 1}, (5.4) 
S- = {dtq k | k G Z, dtq k < -1}. 

We denote S and S± for the subsets S and S± with respect to dual parameters. 
We define a measure dv(x) by 



/ }{x)du{x) = A / /(z)W>)- 



2 * — ' y=x \ y J l , v=x 



x£S \ .J / x£S 

where the positive constant K is given by 



(5.5) 



„ , , 6(qt)0(adt)0(bdt)O(cdt) , „, 

K = (ab, ae, be, qa/d, q; q)^ (5.6) 

This particular choice of normalization constant for the measure v is justified in 
theorem |l| 

In view of (5.3), we can relate the discrete masses v({x})(= — ^({z -1 })) f° r 
x € 5+ to residues of the weight function A(-), which were written down explicitly 



8 



ERIK KOELINK AND JASPER V. STOKMAN 



in [Q (see also j|, (7.5.22)] in order to avoid a small misprint). Explicitly, we obtain 
for x = aq k G S+ with k G Z + the expression 



, r fe ,x (qa/d,q/ad,l/a 2 ;q) 

iWq }) - 



q, ab, b/a, ac, c/a; q) 9(adt)9(dt/a) 

(a 2 ,ab,ac,ad;q) k (1 - a 2 q 2k ) K 
(q, qa/b, qa/c, qa/d; q) k (1 - a 2 ) 2d 2k 



(5.7) 



for the corresponding discrete weight. For fixed k G Z+, the right hand side of 
( |5.7| ) gives the unique continuous extension of the discrete weight v({aq k }} and 
— v[{a~ 1 q~ k }) to all parameters (a, b, c, d, t) G V satisfying aq k > 1. Furthermore, 
the (continuously extended) discrete weight ^({ag fc }) is strictly positive for these 
parameter values. 

A similar argument can be applied for the discrete weights ^({x}) (= — ^({cc -1 })) 
with x G S-. Explicitly we obtain for x = dtq k G S- with fc G Z, 



q, g, a/cit, fe/dt, c/tit, adt, 6dt, cett; qj 

(l/t,a/dt,b/dt,c/dt;q)_ k ( \ \ K~a 2k 



(q/adt,q/bdt,q/cdt,q/d 2 t;q) \ d 2 t 2 q 2k 



(5.8) 



As for with cc G S+, we use the right hand side of (5.8) to define the strictly 

positive weight v({dtq k }) (= — v({d~ 1 t~ 1 q~ k y) ) for all (a,b,c,d,t) G V satisfying 
dtq k < -1. 

We conclude that the definition of the measure v (see (|5.5| )) can be extended 
to arbitrary parameters (a, 6, c, d,t) G V using the continuous extensions of its 
discrete weights given above. The resulting measure v is a positive measure for all 
(a, 6, c, d, t) G V. 

Definition 3. LetJi be the Hilbert space consisting of L 2 -functions f with respect 
to v which satisfy f{x) = f(x~ l ) v-almost everywhere. 

We write v for the measure v with respect to dual parameters (a, b, c, d, t), and 
H for the associated Hilbert space H. 

Let T> C TL be the dense subspace of functions / with compact support, i.e. 

V = {/ G H | /(c^) =0, k > 0}, 

and define 



(J7)(7)= / /(*)0 7 (*)<Mx), /£5 (5.9) 
for generic 7 G C \ {0}. 



Remark 1. Observe that the analytic continuation ( |3.3[ ) of 7 (x) is not defined 
for parameters (a, 6, c, d, t) G V satisfying 9 (a d) = 0. These apparent poles can be 
removed in view of the original definition (3.2) for (fi-y(x) = <p~-i (x) in terms of very 
well poised (observe that q/d < 1, so that either \q"f/d,\ < 1 or [q/dj] < 1 for 

7 G C \ {0}, hence 7 can be expressed in terms of the original definition ( |3.2| ) for 
generic 7). In particular, the transform T is well defined for parameters satisfying 
9{ad) = 0. 



THE ASKEY-WILSON FUNCTION TRANSFORM 



9 



We write T> C TL (respectively T) for the dense subspace V (respectively the 
function transform J-) with respect to dual parameters (a,b,c,d,t). The main 
theorem of this paper can now be stated as follows. 

Theorem 1. Let (a,b, c, d,t) £ V. The transform T extends to an isometric iso- 
morphism T : TL — > TL by continuity. The inverse of T is given by J- . 

We will discuss the proof of theorem [j] in detail in the remaining sections. 

Definition 4. The isometric isomorphism T : TL — > TL is called the Askey- Wilson 
function transform. 

Theorem |l| gives a simultaneous generalization of the L 2 -theory for the Mellin- 
Fock transform and for the (rank one) Hankel transform, see || and |10|j . In 
fact, the Askey- Wilson function transform is on top of an hierarchy of several 
different generalizations of the Mellin-Fock and Hankel transform, in analogy with 
the polynomial setting. This point of view is emphasized in flip] . In particular, the 
Askey- Wilson function generalizes the Jacobi function as well as the Bessel function 
to the level of very well poised s</>7 series. 

Theorem [l] may be partially reformulated in terms of orthogonality relations for 
"low degree" Askey- Wilson polynomials with respect to the measures v (t < 0). We 
say more about this point of view in section 7, where we prove the orthogonality 
relations for the Askey- Wilson functions 4> 1 (7 £ S) with respect to the measure v 
as an intermediate step of the proof of theorem [I]. 

6. The Wronskian. 

We let Xk € T> for k S Z with k <C be the characteristic function which is zero 
at dtq m ,d~ 1 t~ 1 q~ m for m e Z with m < k and which is equal to one otherwise. 
The sequence {xk}k of characteristic functions is an approximation of the unit, in 
the sense that \kf — > f in TL as k — > —00 for all / 6 TL. 

The starting point for the proof of theorem [j] is the following simple observation. 

Lemma 2. Let f,g £T> and k <Si 0, then 



Xk (x) (Tf) (x) (Fg) (x)du{x) 



/ (7)3(7') / Xk{x)<j) 1 {x)<j) ll {x)dv{x) d{y x v)(-y,j') 



Proof. We substitute the definition of the dual Askey- Wilson function transform T 
into the left hand side of the desired identity, and we use that 



4>Ai) = <t>x{l) = h (x) 



for x G supp(z/) and 7 S supp(i/), see (3.4) for the second equality. We arrive at 



Xk{x)(Ff)(x)(Tg){x)dv(x) = 

Xk(x) ( [ /( 7 )<M*)^( 7 ) N ) ( / W)M X )®W) ) Mx)- 



10 



ERIK KOELINK AND JASPER V. STOKMAN 



Since /,j € D, all integrations are over compact subsets, so we may use Fubini's 
theorem to interchange the order of integration. This yields the desired result. □ 

The proof of theorem |l| now hinges on the explicit evaluation of the weak limit 
as k — > — oo of the function 

(7,7') i-> J Xk(x)(f> y (x)(f>Y(x)du(x) (6.1) 

with respect to the product measure v x v. 

As a first step, we express the integral (|6.l|) in terms of the Wronskian of the 
Askey- Wilson functions 7 and </y . Here the Wronskian [/, g] (x) for two functions 
/, g : I — + C is defined by 

[f,g}(x)=2is({x})a(x)(f(x)g(qx)-f(qx)g(x)), x e S^, (6.2) 

where a(x) is given by ( [2.4| ). 

Proposition 2. Let (a,b,c,d,t) G V. For generic spectral parameters 7,7' G C 
such that ^(7) ^ ^{l'), we have 

Xk{x)(j) 1 {x)(j) 1 '{x)dv{x) = ^21^2 1^ - 1 

/or fc G Z sufficiently negative. 

Proof. The proof of the desired identity simplifies when we slightly perturb the 
parameters (a, 6, c, d, t). The proof for parameters (a,b,c,d,t) G V can then be 
derived from the perturbed case using the fact that the left and right hand side of 
the identity depend continuously on the parameters (a, b, c, d, t) . 

Let us indicate one class of possible perturbations of the parameters which is 
sufficient for our purposes. Let (a, (3, 7, 6, t) G V with a, S, aS, —St ^ q z . Let e > 
be sufficiently small, then we set 

a = ae me , b = f3e 2 ™, c = ie 3me , d = 5e~ 6me , 

while we keep t undisturbed. Observe that \a\ = a, \b\ = f3 etc., and that 
abed — af3jS. Note that the weight function W(x) (see (pMty) corresponding to 
the parameters (a, 6, c, d, t) only has simple poles. We can now define the (in gen- 
eral comp lex) meas ure v with respect to the parameters (a, 6, c, d, t) by the same 



formulas (^4) and (5J3) as before. We also keep the same notations for the other 
parameter-dependent objects we have encountered (such as e.g. 7 , Xk etc.). Then 
for spectral parameters 7,7' £ C \ {0} with 7 ±1 , (7 / ) ±1 7^ q 1+l /d (I G Z + ) we can 
write for k <C 0, 

K f [W(x)\ 

Xk{x)4> 1 {x)4> 1 '{x)dv{x) = -— I 7 (x)0y(:r) dx, (6.3) 

4mJ xeCk \ x ) 



where Ck is a continuous, rectifiable Jordan curve in the complex plane, satisfying 
the following additional conditions: 

— Ck has a parametrization of the form rk{z)e 2mz for z G [0,1] with posi- 
tive radial function r^ : [0,1] — > (0,oo) (we orientate Ck according to this 
parametrization) ; 

— Ck is invariant under inversion, i.e. C^ 1 = Ck, where C^T 1 = {x^ 1 \ x G Ck}; 

— The sequences {aq l , bq l , cq l , q 1+l /d}i & % + are in the interior of Ck] 

— The intersection of the g-interval / with the interior of Ck is given by the 
sequence {dtq m \ m G Z : m > k}. 
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The existence of Ck is easy to prove with our choice of perturbed parameters, and 
( |6.3j ) is then a direct consequence of Cauchy's theorem. 

Now recall that the Askey- Wilson function <fi 1 is an eigenfunction of the second- 
order g-difference operator L with eigenvalue fJ.("f), see section 3. This implies that 



(m(7)-M7')) J Xk{x)<j) 1 {x)(j> 1 i{x)dv{x) = 

K f (W(x)\ 
= 4tH J vJ J< th)( x ) < l > ^( x ) ~ 07 0*0 (^7') 0*0) y ~ J dx - 

In view of the explicit expression for L (see ( |2.4|) ), we can write 

(L(f) 1 )(x)<f>y(x) — 7 (x)(L^> 7 ')(x) = a(l/x)£ ia '{x/q) — a(x)£ in '(x) (6.5) 

with 

£ 7l7 '(a:) = (f>~ f (x)4> 7 >(qx) — 4> 1 (qx)4> 1 i{x). 

Furthermore, by the explicit expression for the weight function W(x) (see ( |5.l| )) 
and for the function a(x) (see (2.4)), we have the identity 

a(l/x)W(x) = a(x/q)W(x/q). (6.6) 



Substitution of ( p.5| ) and ( p.6| ) into the right hand side of ( |6.4| ) then shows that 
(/i(7) - mCV)) y Xk(x)(j>'y(x)(l>Y{x)di>(x) = 

= / dx - 

J xeq -i Ck -c k \ x J 

Using the explicit form of the contour Ck, we can shrink q Ck back to Ck in the 
right hand side of (3.7) while picking up residues of the integrand at the simple 
poles x — dtq k ~ 1 and x — d~ 1 t~ 1 q~ k . By (6.6) and by the identity £ 7i7 '(x) = 
— £ 7)7 '(q , ~ 1 a:~ :L ), we can pull the two residues together, yielding 



(m(7)-M(Y)) / Xk{x)4> 1 {x)<p 1 ,{x)du{x) = 

=K Res ( ™M\ a{dtq k - l )^ Y (dtq k - 1 ) 



y=dtq k ~ 1 \ y 

=[^,(t>^]{dtq k - 1 ), 

as desired. □ 

7. Orthogonality relations. 

If we take in (|6 . l| ) the values of the spectral parameters 7,7' in the discrete 
support S of the dual measure T>, then the limit of (6.1) as k — > —00 can be 
taken point-wise. We evaluate these limits in this section, which lead to explicit 
orthogonality relations for the Askey- Wilson functions 7 (7 € S) with respect to 
the measure v. This essentially establishes theorem [j] for the "completely discrete 
part" of the Askey- Wilson function transform. 

Lemma 3. The Askey-Wilson functions 7 (7 G S) are elements of the Hilbert 
space TL. Furthermore, 



4> 1 {x)(j)^{x)dv{x) = 0, 7,7'eS", 7^7'- 
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Proof. We first observe that the asymptotic behaviour of the discrete weights 
v \{ x s) (x E S-) is given by 



M 

where M is the positive constant 



v({dtq- k }) = ^(l + 0(q k )), fc^oo, (7.1) 



M= (72) 

{q,q;q)e(adt)9(bdt)9(cdt)' 



This is a direct consequence of the explicit expression ( |5.8| ) for v[{x\) (i e 

For the moment we assume ad g z and a, dt ±g2 z in order to be able to 
apply the c- function expansion for 7 (7 £ S). We fix 7 G S, so that 7 (x) = 
c(7 -1 )$ 7 -i (x) for x £ S- sufficiently negative by proposition [TJ Observe that 
the apparent poles of c(7 _1 ) as function of the parameters (a, b, c, d,t) € V are 
removable. Hence we can extend the definition of the c-function c(7 _1 ) to parameter 
values (a, b, c, d, t) € V by continuity and we obtain 

for all (a, b, c, d,t) £ V ii x £ I is sufficiently negative. Since 

$ 7 -i(dtq- k ) = (a~/- 1 ) k (l + 0(q k )), k 00 (7.4) 



and I7 1 | < 1 for 7 e 5, it follows from ( |7.l| ) that ^eH for all 7 e S. 

Fix now 7,7' € S with 7 7^ 7'. Then ^(7) 7^ ^(7') by (2.5), hence by proposition 
^| and by the previous paragraph, 

1 



(j) 1 (x)4> y (x)dv(x) = —— — — - lim [0 7 ,</y](cftg k ). (7.5) 

IM(7J - M(7 )) k ^°° 

Here we have used the fact that 4>y{-) is real valued on supp(^) in order to get rid 
of the complex conjugate in the integrand. 

It remains to prove that the limit in the right hand side of J7.5| ) tends to zero. 
Let / and g be two functions in the Hilbert space Tt. By the asymptotics (7.1), we 
have f(dtq~ k ) — o{a k ) as k — > 00, and similarly for g. Furthermore, we have the 
asymptotics 

a(dtq- k ) = a 2 (1 + 0(q k )) , k -» 00 (7.6) 

for the coefficient a(-) of the Askey- Wilson second order g-difference operator L (see 
(2A))- Combined with (\T%, it follows from the definition (3.2) of the Wronskian 
that 

lim[f,g](dtq- k )=0, Vf,g€H. 

k — >00 



In particular, the limit in the right hand side of (7.5) tends to zero, hence 4> 1 is 
orthogonal to (f> y > in TL. □ 

The quadratic norms of the Askey- Wilson functions 7 (7 £ S) in H can be 
evaluated as follows. 



Lemma 4. For all 7 € 5, 

|0 7 (x)| 2 iii/(a;) 



2£({ 7 })' 
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Proof. As in the proof of lem ma |3j , we assume for the moment that ad ^ q z and 
that a, dt £ ±g5 z . In view of ( [7.3|) , (7.4) and (7.1), these generic conditions can be 
removed at the end of the proof by applying the dominated convergence theorem. 
We fix 7 € S, then by lemma || and proposition ||, 

\(j) 1 (x)\ 2 dv(x) = lim / Xk{x)4> 1 {x) 2 dv(x) 



k 



lirn^ ylirn^J Xk(x)(/>y(x)(f>y(x)di>(x)\ (7.7) 



' — CO V 7'^7 

[(/) J ,(j)Y](dtq- k 



lim lim 



fc^oo (^(7) - /x( 7 ')) 

where we used that </> 7 (-) is real valued on supp(^) for the first equality. 

It remains to evaluate the limits of the Wronskian in the last equality of ( |7.7j). 
We u se t he c-function expansion for the Askey- Wilson functions (see proposition |lj 
and (7.3)) to rewrite the Wronskian as 

[^,^}(dt q - k ) =c( 7 - 1 )c( 7 0[V i J <M(^<r fe ) 

+ c(j- 1 n 1 '- 1 )l%- 1 ,%,- 1 }(dtq- k ) 

for k 3> 0. Now there exists open neighbourhoods U± of 7 ±: in the complex plane 
such that 

$ 1 >(x) = $ f J ee (x)(l+f Y (x)), xeS_, x«0 (7.9) 

where /y (x) admits a convergent power-series expansion around x = —00 with 
coefficients depending analytically on 7' S L/± and with constant coefficient equal 
to zero. Furthermore, for sufficiently small neighbourhoods U±, differentiation with 
respect to 7' may be interchanged with summation in the power series expansion 
of fj'(x) around x = —00 when |x| > > for some U± independent positive 
constant N. 

Combined with ([7.9|), we see that 

[^-^ y ±t](dtq- k ) = 

=2^({^-n)«(^)« 2fe - 1 (7- 1 7' ±1 )^ 1 (7- 1 -7' ±1 )(l + 0(9 fe )) (7 ' 10) 

as k — > 00 , with 0(q k ) uniform in 7' 6 U±. Now we substitute ((7J) in ((7J), and 
we use the fact that 0(7') has a simple zero at 7' = 7 and that 

M7)-M7') = ^(7-7')(7-7'- 1 ), (7.11) 
then using ( 7.10| ) and the fact that I7I > 1, we derive that 

[cj )l ,^]{dtq- k ) = 2 V {{dtq- k }) a {dtq- k )h 2k - 1 { Sk { ll 7') + ^7, Y)) (7.12) 

with 

*k{l,j) = E c(7 ,£ )?(7- 1 )7' e( ^ 1) 7 1 ^(7" 1 -7 e ) (7.13) 
£=±1 

and with a remainder term ^(7,7') satisfying 
7 '^7 (m(7J - W )) 
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Using ( [7.11 ), (7.13) and the fact that 0(7') has a simple zero at 7' = 7, we derive 

(7.15) 



lim 



(m(t) - M(V)) « \c(t 1 )7'=7 V c (7')/ / S (7 1 - 7)7 2fc 
K 1 7 c^ 1 ) 2 



ac 2v({j}) a (7 1 - 7)7 : 



2A- 



where if and cq are the constants K (see (5.6)) and cq (see (5.2)) respectively 



with respect to dual parameters. Here we have used (5.1) and ( ]5 . 5| ) for the second 
equality. 



We can evaluate now the limit s in t he la st equa lity of (7.7) by substituting ( 7.12 ) 
for the Wronskian and by using (7.1), (7.6), ( 7.15 ) and ( 7.14 ) together with the fact 
that I7I > 1. This gives 



\4> 1 (x)\ 2 du(x) 



KM 



co 2^({ 7 }) 



By a direct computation one verifies that KM/cq = 1, which completes the proof 
of the lemma. □ 

Let T>d C T> be the sub-space consisting of the functions in T> which are sup- 
ported on the discrete support S of the measure is, and let T>d be the sub-space T>d 
with respect to dual parameters. In view of lemma ^| and lemma ^, we can now 
reformulate lemma ^ and lemma |] in the following way. 

Proposition 3. Let f,g£ T>d, then Tf,Tg G Ti. and 



[Ff) (7) fa) (7)^(7)= / f{x)g{x)dv{x). 



Recall from (p^a) that 



bj is a multiple of the Askey- Wilson polynomial pk when 
7 = 7fe = aq k G S+ [k G So if a > 1, then lemma ^ and lemma |] give explicit 
orthogonality relations for the "low degree" Askey- Wilson polynomials pk (k G Z+, 
k < ko) with respect to the one-parameter family of measures v (t < 0), where fco is 
the largest positive integer such that dq k ° > 1. The sub-space spanned by {pk}k°=o 
is exactly the sub-space of polynomials in x + x^ 1 which are square integrable with 



respect to v (this follows easily from (7.1)). Furthermore, the functions 7 G TL with 



7 G S— constitute an explicit family of mutually orthogonal functions with respect 
to the measure v, which in addition are orthogonal to the finite set of Askey- Wilson 
polynomials pk (k G Z + , k < ko)- 

From this point of view, lemma ^ and lemma || bear close resemblance with in- 
determinate moment problems and non-extremal measures. In fact, the measures v 
(t < 0) formally reduce to a genuine one-parameter family of non-extremal orthog- 
onality measures for some indeterminate moment problem in certain degenerate 
cases of the Askey- Wilson function transform. This point of view was emphasized 
in [ p^| , where it was for instance shown that a formal limit of the above orthog- 
onality relations leads to a one-parameter family of non-extremal orthogonality 
measures for the continuous dual g _1 -Hahn polynomials, see also ||. 

Remark 2. Fix l;£Z sufficiently negative, and let 71 (fe), 72 (k) be two zeros of the 
function 7 1— * (f>- y (dtq k ^ 1 ) such that /u(7i(fc)) ^ /i(72(fc)). Then proposition [2] implies 



that the Askey- Wilson functions 



? 7l(fe) 



and </> 72 (fc) are mutually orthogonal with 
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respect to the measure Xk(x)dv(x) of compact support. These Fourier-Bessel type 
orthogonality relations for the Askey- Wilson functions were derived and studied by 
Suslov in H and @. 



8. The continuous part of the Askey- Wilson function transform. 



In this section we first evaluate the weak limit of (6.1) as k — > — oo with respect 
to the product measure u\j x v\j. We directly formulate the result in terms of 
suitable unitarity properties of the Askey- Wilson function transform (compare with 
proposition || in the square integrable setting). 

Let T> c C T> be the sub-space consisting of the functions in V which are supported 
on T, and let V c be the sub-space V c with respect to dual parameters. Observe 
that V = V c T>d is an orthogonal direct sum decomposition of the dense sub-space 
VcH. 

Proposition 4. Let f,g € T> c , then Tf,Tg £ Ti and 

J (7) 0^X7)^(7) = / mW)d»{x). 

Proof. The proof is similar to the proof of || prop 7.7] and of prop 6.1], where 
the analogous statement was derived for the big and the little g-Jacobi function 
transforms, respectively. Since some care has to be taken in order to match the 
constants, we repeat here the proof in some detail. 

We prove the proposition with respect to dual parameters (cf. lemma 0). It 
suffices to prove it for functions /, g £ T> c which are continuous on T and supported 
within T\ {±1}. 

We use lem ma |[ proposition || and the explicit form of the measure v\i (see 
( [Tj] ) and (|5.5| )), together with the invariance of the Askey- Wilson function </> 7 and 
the measure dV(pf) under 7 1— * 7 -1 , to write 



Xi-k (x) (Ff) (x) {Fg) (x)du(x) 



~ ^oJe>=oJe=o " ^ ' (M(e^)-M(^')) W iB )? \c{e i6 ')\ 2 

for k G Z sufficiently large. It suffices to prove that the right hand side of ( |S.l|) 
tends to J f{^)g{^)dv{^f) as k — > 00. 



In order to compute the limit k — > 00 of the right hand side of (8.1), we first 



observe that the factor fi(e ) — fi(e ) occuring in the integrand can be rewritten 



as 



fx(e ie ) - v(e l9 ') = de- l6 (e* e - e l6 ') {e w - e^ 6 ') 
= —Aa sin 



cf. ( |7.11| ). Similarly as in the proof of lemma ^ we derive now from the first 
equality in ( ]8.2| ) , the c-function expansion (see proposition |l|) and the mean value 
theorem, that 

[<t> e ,e^ el e>]{dtq- k ) = 2v({dtq- k })a(dtq- k )d 2k - 1 ( Sk (0, 8') + r k (6 , 9')) (8.3) 
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with 

s fc (0,0') = Y, c^cCe^V^-^V^- 1 ) 

e,e'=±l 

and with a remainder term rk(9, 9') satisfying 



sup 

8<e^8'<ir-8 



r k (9,9') 



(Me ie )-/x(e ie ')) 



= 0(kq k ), 



e ' e ') (8.4) 



(8.5) 



for all < S < 7r/2. We substitute the expression (3.3) for the Wronskian in the 
right hand side of (8.1). In view of the asymptotics (7.1) and (7.6), it then suffices 
to calculate the limit k — > oo of 



K 2 Ma 



o J8'=oJe=o 



f(eng(e ie ')- 



s k {e,9')+r k (9,9')) d9 



d0' 



(fi(e ie ) - fi(e iS ')) \c(e* 9 )\ 2 |c(e ie ')l s 



(8.6) 



The asymptotic behaviour (8.5) shows that the limit k — > oo of the integral (3.6) of 
the remainder term r k (9, 9') giv es ze ro by dominated convergence. By the Riemann- 
Lebesgue lem ma, the integral (|8.6| ) of the two terms from s k (9,9') corresponding 
to ee' = 1 in (B.4) tend to zero as k — ► oo. It thus remains to calculate the limit 
k — > oo of ( |S.6| ) in which the factor (s k {9, 9') +r k (9, 9')) of the integrand is replaced 

by 



t k (9,9') = Y c(e^)c(e^' e ': 



j(k-i)ee e nk-iye' [ e i 



e,e'=±l 

££' = -1 



(c(e-* e )c(e* 6 ' ) - Z(e w )Z(e- w ' )) e *<*-*>C«-0 (e 
(2/c- l)(0-0') 



-iB _ e i6'} 



4 sin 



sin 



c(e* e )c(e-* e ). 



It follows now by yet another application of the Riemann-Lebesgue lemma that it 
remains to calculate the limit k — > oo of 



K 2 M 



7-/sin((2fc- l)(0-0')/2) 



(16 



.=0 J 8=o fiel { sin ((0 - 0')/2) ) c( e -«) c(e"') 

Now by the well known L 2 -properties of the Dirichlet kernel, the limit k 
(p?7|) exists, and it equals 



(8.7) 

oo of 



K 2 M 



/(e*) 5 (e"). 



r/0 



=o 



c-(e^)| 2 



ATM 

Co 



The proposition follows now directly from the fact that KM/co = 1 (compare with 
the proof of lemma 0) . □ 



In order to completely understand the weak limit of fl6.l| ) as k — > — oo with re- 
spect to the product measure vxv, we still have to deal with the mixed continuous- 
discrete case. This case is covered by the following lemma. 

Lemma 5. Let f S T> c and g £ T>d, then 
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Proof. We establish the desired identity with respect to dual parameters. Let / G 
V c and g &T>d- By proposition || and proposition || we have Tj G Ti and Tg € W 
respectively. In particular, we may assume without loss of generality that / is 
continuous on T, and supported within T \ {±1}. For 7 G S U S^ 1 we now define 

f-y € T> c by f-yi'Y) — f (70/(m(7) — m(7')}- Observe that is continuous on T and 
supported within T \ {±1}. By lemma y and proposition g we can now write 

J (Tf){x)(Tg){x)dv(x) = 



Now we observe that (7.3), (7.4), proposition [l] and the asymptotic behaviour 



sup \$y±i(dtq k )\=0(d k ), fc -> 00 

-y'esupp(f^) 



imply that 



sup \[<f> 1 ,(py](dtq- k )\ =2v{{dtq- k })a{dtq- k )h 2k ~ 1 \ 1 \- k O{\) 
-y'£supp(f y ) 

= o(h\- k ) 



as k — > 00, where the second equality is a consequence of ([Fj]) and (7.6). But 
I — ^ I 1 < 1 for 7 6 S, hence we may use Lebesgue's dominated convergence theorem 
to interchange limit and integration in the right hand side of (|3.S|). It follows 
that the right hand side of ( |8.8| ) tends to zero, which completes the proof of the 
lemma. □ 



9. Completion of the proof of theorem 
In this section we complete the proof of theorem |l|. 

First of all, we observe that the results of section J?] and section || immediately 
imply that the Askey- Wilson function transform T extends to an isometry T : Ti — > 
Ti. Indeed, it follows from proposition [§[ proposition^ and lemma together with 
the orthogonal direct sum decomposition V = V c T>d, that 

J (J7) (7) {Fg) (7)^(7) = J f(x)Wjdu(x), f,geV. 

Since T> C Ti is dense, it follows that the Askey- Wilson function transform T 
uniquely extends to an isometry T : Ti — ► Ti by continuity. In particular, the dual 
Askey- Wilson function transform T : Ti — » Ti is an isometry in view of lemma [lj. 

Fix now arbitrary / G Ti and g £ Ti, and write Xfc G 2? (fc G Z sufficiently 
negative) for the characteristic function \k with respect to dual parameters (see 
the beginning of section ^J). Since T : Ti — > 7Y and T :Ti ^Ti are continuous, we 
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have 

(jFf){x)g(x)dv(x) = k Jim / ( / Xfc(7)/(7)^ (7)^(7) ) Xm{x)g{x)dv{x) 



rn — ► — OO 



lim Xk{l)f{l)\ X m {x)g{x)(j) 1 {x)du{x))dv{-f) 

k.m— > — 00 



f{l){Fg)(l)dv{l), 



where we used Fubini's theorem, the duality (^J) of the Askey- Wilson function, 
and the fact that the Askey- Wilson function (j)~ ( (x) is real- valued for x S supp(^) 
and 7 £ supp(t'). But then we have for all /, g G TL 1 



{F(Ff))(x)g(x)dv{x)= (?f) (7) {Fg) (7)^(7)= f(x)g{x)dv{x 



since T : TL —* 7i is an isometry. It follows that ToT = Id-^. By a similar argument, 
we obtain T o T = Id^ (or simply replace the parameters by the corresponding 
dual parameters in T o T = Idu and use lemma [l]) . 

We conclude that T : 7i — * H and J 7 : H ^ H are isometric isomorphisms, and 
that = J-^ 1 . This completes the proof of theorem |l|. 
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